RECOVERY OF EDGES FROM SPECTRAL DATA 
WITH NOISE A NEW PERSPECTIVE 



SHLOMO ENGELBERG AND EITAN TADMOR 

Abstract. We consider the problem of detecting edges in piecewise 
smooth functions from their iV-degree spectral content, which is as- 
sumed to be corrupted by noise. There are three scales involved: the 
"smoothness" scale of order 1/N, the noise scale of order 77 and the 0(1) 
scale of the jump discontinuities. We use concentration factors which 
are adjusted to the noise variance, r\ 3> 1/N, in order to detect the 
underlying C(l)-edges, which are separated from the noise scale, r\ <C 1. 
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1. Introduction and statement of main results 

We consider the detection of edges in piecewise smooth data from its 
Fourier projection, 

s N f{x) = K k Y kX ' /(*0 : = y r f(0e 

\k\<N 71 J ~ n 

Our approach is based on the technique of concentration kernels advocated 
in [U [5] and the closely related techniques described in [3] . The technique 
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presented makes use of the fact that if / is discontinuous, its Fourier coeffi- 
cients contain a slowly decaying part associated with the jumps of /. This 
part decays much more slowly than the rapidly decaying smooth part of /. 
For example, if / is smooth except for a single jump discontinuity at x = z 
of size [f](z) := f(z+) — f(z-), the jump discontinuity is associated with 
slowly decaying Fourier coefficients, 

f {k) = [f]{z) iS; +m > [f](x):=f(x+)-f(x-), 

where are the Fourier coefficients of s - the smooth part of /; the 
smoother s is, the faster is the decay of s(k). Concentration kernels succeed 
in separating the two sets of coefficients. To this end one computes 

JC% * (S N f)(x) = tti J] sgn(k)a N Ojjr) /(fc)e i 

Here, o"at(£) can be drawn from a large family of properly normalized con- 
centration factors that are at our disposal. The resulting function tends to 
zero in regions in which / is smooth and tends to the amplitude of the jumps 
at points where the function has a jump discontinuity, 

-logiV^ 



ikx 



IC%*(S N f)(x) = [f}(x) + K y 

Thus, edges are detected by separation of scales. 

In this paper we utilize concentration kernels to detect edges from spectral 
information which is corrupted by white noise. In this context we observe 
that there are three scales involved - edges of order 0(1), noise with variance 
0(jj) and the smooth part of / which is resolved within order 0(1/N) or 
smaller. Here, we can separate the noisy part, n(x), from the smooth part, 

s(x) — ► s(x) + n(x), E(\n(k)\ 2 ) = rj; 

if 77 ~ 1/N then the noisy part could be identified with (or below) the 
0(l/./v~)-variation of the smooth part of /. In this case, there are essentially 
two scales and edges can be detected using the usual framework of concen- 
tration kernels advocated in [HE]. Thus, our main focus in this paper is 
when the smoothness scale is dominated by the scale of the noise which is 
still well-separated from the 0(l)-scale of the jumps, 

N 1 

The spectral information is now corrupted by white noise, affecting both 
low and high frequencies, 

f(k) = [f](z)^-+s(k) + n(k) 

In order to separate edges from the noisy scale, the edge detector, K^f(x), 
must be properly adapted to the presence of white noise. We show how to 
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design edge detectors that optimally compensate for noise and for the effects 
of the smooth part of the signal. 

The paper is organized as follows. In section [2] we discuss the general 
framework of edge detection based on concentration kernels. We revisit the 
results of [5j [7] , providing a simpler proof for the concentration property for 
a large family of concentration factors. In particular, we trace the precise 
dependence of the error on the regularity of the associated concentration 
factor. This will prove useful when we deal with noisy data in section [3l 
Here, we introduce our new perspective, where concentration factors are 
derived by a constrained minimization while taking into account the two 
main ingredients of our data — jump discontinuities and the noisy parts 
of the data. Numerical results are demonstrated in sections HI In section 
[5] we extend our construction of concentration factors to include the three 
ingredients of the data — taking into account the smooth part of the data 
in addition to the edges and noisy parts; numerical results are presented in 

El 



2. Detection of edges - concentration kernels 

Consider an / which is piecewise smooth in the sense that it is suffi- 
ciently smooth except for finitely many jump discontinuities, say at x = 
zi,z 2 , ...,zj, where 

[/](*,•) := f( Zj +) - f(zj-) + 0, j = 1,2, ... J. 

Given the Fourier coefficients, {f{k)}^ = _ N , we are interested in detecting 
the edges of the underlying piecewise smooth /, namely, to detect their 
location, z\, . . . , zj and their amplitudes, [/](zi), ■ ■ ■ , [f](zj). 
We utilize edge detection based on concentration kernels 

(2.1a) K%{y) := sinky, ^ G C X [0,1]. 

We shall need the kernel —KL a N to have (approximately) unit mass, 

1* 1C N {y)dv * -1. 
Jo 

To this end, we require that <r(£) = ctn(^) be a properly normalized concen- 
tration factor; that cr(£) satisfy 

(2.1b) f = 1. 

Jo ? 
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Indeed, the rectangular quadrature rule yields 



l' 7, 
Jo 



K°N{y)dy 



N 

£ 

k=l 



a 



(-1)* 



1 



N 

E 



g(&) 2 
6 ^ 



fe odd>l 

with an error estimate, e.g., [Sl[2], 



M0 



de + eo(iV), 



f •=- 



(2.2) 
We set 1 



K° N {y)dy + l <e {N), e (N) :-- 



K° N f{x) := JC% * f(x) 



£ s S n ( fc W f ^ ) 7(^)e ifca; 

|fc|<JV 



iV 



|fc| 



<M0 



BV 



Our purpose is to choose the concentration factors, <7jv(|A;|/iV), such that 
K c N f{x) « [/](x). Thus, tfft/(s) will detect the edges, [f]( Zj ), j = 1, . . . , J, 
by concentrating near these 0(l)-edges which are to be separated from a 
much smaller scale of order K^f{x) ~ in regions of smoothness. In the 
following theorem we present a rather general framework for edge detectors 
based on concentration factors. In particular, we track the precise depen- 
dence of the scale separation on the behavior of a. 

Theorem 2.1 (Concentration kernels). Assume that /(•) is piecewise smooth 
such that the first-variation of f is of locally bounded variation, 

f(x + y)-f(x-y)-[f](x) 



(2.3) Uf(y) = u f (y;x) 



G BV[-7r,ir]. 



sin(y/2) 

LetK? N {x) be an admissible concentration kernel h2.1\) . such that 



(2.4a) 
(2.4b) 
(2.4c) 

(2.4d) 

Set 

(2.5) 



e (N) 
e 1 (N) 
£2 (AO 
£3 (AO 



1 

N 
1 

N 
1 

N 



BV 



<1, 



o-jv(I)] < 1, 

1 \ojm 

JV 

1 , 

< 1. 



d£ < 1 



aN[ N 



e N := £ (N) + £l (N) + e 2 (N) + e 3 (N). 



We observe that -K^r/ is the operator associated with but otherwise different from the 
concentration kernel K, a N {x). 



SPECTRAL DATA WITH NOISE 

Then, the conjugate sum K^f(x), 



(2.6) 



K%f{x) =^Y1 sgnCAOo-jv C§) f(k)e ik *, 

\k\<N ^ ' 



satisfies the concentration property, 

[f](zj) + o(e N \ x ~ Zj, j = 1, . . . , J 



(2.7) i^/(x) ~ 



Proof. We simplify the proof in [7] . The key to the proof is to observe 
that fC^j is an appropriately normalized derivative of the delta function; in 
particular, since K, a N {-) is odd 



K° N *f{x) = - J KMv)(ttx + y)-f(x-y)y y 

K> a N {y)(f(x + y) - f{x -y)- [f]{x))dy - [f](x) x f K%(y)dy. 



Since a is assumed normalized, the error estimate (|2.2p tells us 



K%(y)dy = -l + e (N), s Q (N) = -j- 



MO 



and we end up with the error estimate 

(2.8) -[/](*)| < r Bin{y/2)K^{y)uj } {y; x)dy +O(e (N)). 

Jo 

To upperbound the expression on the right, we sum by parts, deriving the 
identity 

h(y) 



2sin(y/2)/C^(y) = ^(1) cos ( N + -jy 



h k (y) 



h(y) 



N-l' N , s 

+ ( aN ^k) ~ o-N^k+i)) cos (k + -Jy - (Tn(£i) cos (-J . 



k=l 



In our case, the errors for the trapezoidal and rectangular rules provided respectively 
in [2] and [6] coincide modulo the 0(si(N) +e 3 (A r )) terms. 
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The usual cancelation estimate, 
implies 



cos ((k + -)y)w(y)dy\ < \\w\\ B v/\k + -| 



h(y)uf{y)dy 
hk{y)uf{y)dy 

7T 

h(y)uf(y)dy 
We conclude 

yR N (y)uf(y;x)dy 

N-l 



o-Jv(l)| • -\\u; f (-,x)\\ B v < etWWuf^x^Bv, 



k+lj 



e 3 (JV) • \\u f (-;x) 



(2.9) < | 

< (e x (JV) + £2 (JV) + e 3 (iV)J IMOIIw- 
The result (H3D follows from (ES) and (1231). 



□ 



As an example, we consider the noise-free case with a concentration factor 
for which 



(2.10) 



MO 



EC 1 . 



Clearly £o(N) ~ 1/iV, and since a is bounded, £i(N) ;$ 1/iV. Moreover, 
since a^y(£) is bounded, 



log(A f ) 
N 



Finally, since |ojv(£)| ~ £ then £s(N) < 1/N. Theorem 12.11 yields the follow- 
ing result of [5j [7] for edge detection in piecewise-smooth, noiseless data. 

Corollary 2.2 (Concentration kernels). Assume that /(•) is piecewise smooth 
such that \2. 3\) holds. Let K^ix) be a normalized concentration kernel $2.1}) 
with G C 1 . Then K^f(x) satisfies the concentration property with 
e N = log(JV)/JV, 
(2.11) 



Kfrf(x) ~ 



[/](%') + 



0( log^V) ); 



log(AQ \ 
AT / 



, X~Zj, j = l,...,J 

dist\x,{zi,. . -,zj}} > — . 
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3. Noisy data - a new perspective 

3.1. Constrained minimization. Assume that / experiences a single jump 
discontinuity at location z of height [/](^). This dictates a first order decay 
of the Fourier coefficients, 

— ikz 

(3.1) /(AO = [/](*) 2^jfe+5(A0 

Here, s{k) are associated with the regular part of / after extracting the jump 
[/](c); their decay is of order ~ \k\~ 2 or faster, depending on the smoothness 
of the regular part s(-). The new aspect of the problem enters through the 
n(k)'s, which are the Fourier coefficients of the noisy part corrupting the 
smooth part of the data. We assume n(-) to be white noise whose mean- 
square power at each frequency is E(\n(k)\ 2 ) = r\. With (|3.1h . the conjugate 
sum (12. 6ft becomes 

N 

K° N f{x) = [/] (*) x 2vri Y, J ^f ± cos k (x ~ *) 

k=l 

N k N k 

—2ir Y^ a ( — J^(A0 sin kx — 2ir <r^ — jn(k) sin kx. 

k=l k=l 

We quantify the "energy" of each of the three sums on the right. Ej and 
Er are associated with the discontinuous and regular parts of /, 

N ^(*h a „ i /V(£h 2 

fc=j 

N 



l, 1 ■'O s> 



and E r) (a) associated with the noisy part of / which was assumed to have 
variance r\ 

N , i 

(3.2c) £^(£)iW)| a ) ra ^ / ^(O* = : W 

k=i Jo 

Our perspective for construction of edge detectors for such noisy data is to 
treat the problem as a constrained minimization. We seek a function, ct(£), 
which minimizes the total energy, thus making the conjugate sum K^f as 
localized as possible, subject to prescribed normalization constraint (|2.1bl) . 



(3 



.3) min [ajEj(a) + a v E v (a) + a R E R {a) | J ^-d£ = l}- 
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This yields 

1 

n(n = r I = 

We ignore the relatively negligible contribution of the regular part which 
becomes even smaller as s(-) becomes smoother. Setting an = we end up 
with concentration factors of the form 

(3-4) = £ ^ 




f = -^tan-^/W) = 1, 



aj 1 + rj/PN 2 ? ' 

The corresponding concentration kernel depends only the relative size 
of the amplitudes /3 2 = a^/aj: indeed, the normalization of cr(£)/£ (I2.1bj) 
causes the constant C CT to satisfy 

ajy/v/3 

and we end up with the normalized concentration factor 

(3.5) = ^(fl = tan - 1( ^ w • 1 + rjP 2 N 2^ P = yj-. 

The corresponding edge detector then takes the form 

The concentration factor a = now involves three factors: the ratio 0, 
the noise variance w and the number of modes N. The concentration kernel 
(I3.6P tends to de-emphasize both the low frequencies which are "corrupted" 
by the jump discontinuity(-ies) and the high frequencies which are corrupted 
by the noise. Different procedures yield different policies for the choice of 
/3 = /3(rj); one will be discussed in the next subsection. It is worth noting 
the essential dependence of on the variance of the noise rj. There are 

three scales involved — the small "smoothness" of order ~ 1/N, the noise 
scale of order ~ rj and the C(l)-scale of jump discontinuities. We distinguish 
between two cases. If rj -C 1/N so that y/rjfjN <C 1, then the noise can be 
considered part of the smooth variation of / and cr„(£) ~ £ recovers the 
usual concentration factor for noise-free data. Indeed, cr^(£) = £ at the limit 
of r] I 0. Otherwise, when the 0(l/iV)-smoothness scale is dominated by 
the (P(ry)-noise scale in the sense that ^Jfj/5 £ 1/N, in which we assume the 
noise to be still well-below the 0(l)-scale of the jumps, 

^Zy/rj0<Z 0(1). 

In this case, we can ignore the bounded factor 1/ t&n~~ 1 (y/r}/3N), and we 
compute the small scale dictated by theorem 12.11 Setting := y/rjfiN^ 
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we find, 



eo(N) 
e 1 (N) 



1 

N 
1 

N 
1 

N 



i 



BV 



N 



(i + C 



2\2 



i-C 2 

i/ive(i + c 2 (0) 2 



d£ < y^log {y/fjP) 



and hence (12. 4ft holds with 

e N = e v := ^Plog (y/rj0)- 

It is remarkable to see how the small scale of smoothness in the noise- 
less case, 0(log(N)/N), is now replaced by the small scale of noise e v = 

O ( y/vP l°g {y/vP) 1 • We now appeal to f|2.7() : since n -C 1, theorem 12.11 

implies that K^J 1 f separates the 0(l)-scale of the edges from the noise scale 
of order <1. 

Theorem 3.1 (Edge detection in noisy data). Assume that /(•) is piecewise 
smooth in the sense that \2. 3\) holds, assume that its spectral data contains 
white noise with variance r\ <C 1. Let fix) be a normalized concentration 
kernel f3.t 



TT 



ik 



f(k)e 



ikx 



associated with the concentration factor 

1 



We distinguish between two cases: 

(i) if y/vfiN < 1 we set the small scale e = en '■= log(iV)/iV '; 

(ii) if l/N Z yjrj(3 « 1 we set the small scale e = e v := ^/rjftlog 
Then, K J 1 f(x) satisfies the following concentration property, 



(3.7) K° N f{x) 



[f]{ Zj ) + 0(e), x~ Zj , j = l,...,J 
0(e), distix, {zi, . . . ,zj}\ » e. 



3.2. Balancing the different types of errors. In order to choose the 
free parameter 0, it is important to know how (3 influences the error at the 
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output of our edge detector. Let us consider E v . We have seen that: 
J o 



(tan-^^iV)) 2 J (1 +r?/? 2 iV 2 £ 2 



\2 



VV f^ N C 2 d( , ^/rj 



^(tan-H^iV)) 2 Jo (1 + C 2 ) 2 S P ' 

As E v is approximately the expected value of the square of the contribution 
of the noise to the output of the edge detector — it is approximately the 
variance of the contribution of the noise, if we want to consider the size of 
the noise, we should consider something related to the standard deviation 
of the contribution. It is customary to bound the noise by some number 
of standard deviations — we will use two standard deviations. We define the 
effective size of the noise's contribution to be 

v l/4 

E V,eff = 2 V E V 



From the results of Theorem 13.11 we find that far from jump the contri- 
bution from the jump is of order y/rjf3. The effective size of this term is 
therefore 

£/,e//~r? 1/2 /?. 

Let us minimize £^, e // + Ej^ e ff with respect to (3. We find that: 

/?~?T 1/6 - 



4. Numerical results. I 

To illustrate the results of the previous section, we present two sets of 
numerical results. We begin with the noiseless case, in Figure l4~Tj where we 
set (3 = 1 corresponding to equal weights for the errors due to the noise and 
the discontinuous parts of the signal. We plot the output of the concentra- 
tion factor when a periodic function with a single jump continuity is used 
as the input. A simple examination of the results shows that the output is 
what we predicted. The output is one at the (unit) jump and is zero away 
from it. As r] gets smaller the value away from the jump tends to zero. 
Considering the figure, we find that the ratio of the size in the continuous 
region is 0.00365/0.00137 = 2.66 ~ \/l0 which is the ratio of the square root 
of the r/'s — as it should be. 

Next, Figure FOI demonstrates the edge detected in noisy data using the 
concentration kernel (|3.6j) with the advocated (3 = -Kr]^ 1 ^ . 
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The Function f(t) 



0.5 



-0.5 







0.5 1 1.5 2 
The Concentrated Output for-q = 0.0001 








0.5 1 1.5 2 
The Concentrated Output for = 0.00001 









1.1368 
1.1368 
1.1368 



1.1368 



The continuous region 




3.3651 ' ■ ' ' ' 

0.3 0.4 0.5 0.6 0.7 



<10~ 3 The continuous region 



0.3 0.4 0.5 0.6 0.7 



Figure 4.1: The output for various values of rj when there is actually no 
noise at the input. 



5. Noisy data and smoothness — concentration kernels 

revisited 

As an alternative approach to the L 2 -minimization offered in Section El 
we now replace the L 2 - "averaged" effect of the regular part taken in (|3.2b|) , 
by the BV-like quantity 



(5.1a) 



N 

w«EK£)|-ft*)i 



k=l 



where the regular part is sufficiently smooth that 



(5.1b) 



l-(*)l~pi- 

As in f)3.3f) . we consider the constrained minimization 
(5.2a) l"'"® 



mm{j(<T) | / 



with J (a) = ajEj(a) + a v E v (a) + anEji(a), where Ej(a) and E v {a) given 
by (|3,2ap and ()3.2c[) but with an alternative expression for the "energy" of 
the regular part motivated by (j5.1|) : E R (a) := f Q |<T(£)|£~ 2 <i£/iV. We find 
that: 



(5.2b) J(a) := — 
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Signal plus noise, 11 = 0.000005 



Concentration Factor, r| = 0.000005 




0.5 1 1.5 

Signal plus noise, t| = 0.000020 




0.5 1 1.5 

Signal plus noise, r| = 0.000125 





0.5 1 1.5 2 

Concentration Factor, r| = 0.000020 




0.5 1 1.5 2 

Concentration Factor, r| = 0.000125 




Figure 4.2: Detection of edges in noisy saw-tooth function corrupted with 
various values of rj, using the concentration kernel (|3.6[) with (3 = ttt]^ 1 ^. 



-^+2r,a v Na(0+ ^ = ^ 



sgn(cr) 





leads to 


1. 


a > 


0, 


a = 


-1, 


a < 



We will show that the resulting optimal concentration factor is given by 
(iV£ - k )+ , an. „ fa^ „ A 



(5.3) a(0 = C a 



1 + ri(3 2 N 2 £ 2 ' 



U aR Ft 




aj 2aj 



Indeed, to justify the passage to (|5.3p . one may consider a regularized version 
of the variational statement (|5.2p . min J e (<r), where 



J Act) := 



involves a mollified absolute value function: 



«h /' 1 k(e)| £ 



<t e , . 
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The solution of the corresponding regularized first variation yields the min- 
imizer: 



- k ■ S gn E (a(0) 



1, a > e, 



rjf3 2 N 2 £ 2 + 1 



-1, a < —e. 



Thus, we end up with the optimal concentration factor, <r(^) = cr e (£), 

«*(0 = 



and (15, 3D is recovered by letting e | 0. Clearly, the resulting optimal con- 
centration factor is non-negative. 

It remains to calculate the normalization factor, C CT , for which 

r 1 i m-k 
a J k0/ N t^N^e + 1 A - 

The integral on the left is found to be 
1 f-ko k oV p 2 N 2 tj + N \ 

k0/N v e ^ 2 ^ 2 ^ 2 + 1 ; 4 

We focus our attention on the "noisy" case when 1/N £ C 1 so that 
the fourth term on the right is negligible while the second term on the right 
is approximated by 

We end up with an approximated integral 

/ ( • • • W « k Hy/VPN) + tan" 1 (y/fj/3N). 

Jk /N V ' -JW 

The balance between these two terms depends on the specific policy for (5 and 
the detailed balance between y/r}(5 and N . Our normalized concentration 
factor takes the form 

(5.4a) a n (£) - 



^/rjPk ln(^/3iV) + tan-^^iV) 1 + r](3 2 N 2 £ 2 

We can simplify this concentration factor in several ways; we mention two 
here. 
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(i) When N is large enough, we have tan 1 {^/fjl3N) ir/2 yielding 

1 (iV£ - k )+ 



(5.4b) 



^(0 



k Hy/rjPN) + vr/(2^/3) 1 + r,(5 2 N 2 ^ 
(ii) Observe that 0>j(£) is rapidly decreasing at £ ~ 1 with 

1 



^(0 



t) /3 2 N "log iV' 



so ct^(^) can be set to zero for £ ~ 1 when N is large enough. In order to 
properly normalize the resulting concentration factor N must be replaced 
by No. This leads us to: 
(5.4c) 

0, k < ko, 

1 (k - ko). 



koH^j(3No) + 7r/(2^(3) 1 + V (3W k ° <k<N °> 
0, N < k < N. 



6. Numerical results. II 



We consider two examples depicted in Figure 16.11 In the first case, we 
have a noise of variance r\ = 2 x 10 -5 to be detected out of the first N S> 1000 



modes. With (3 
find 



7T7] 



-1/6 



15 and by tuning ko = 87r and A^o = 1000 we 



k 



<(#> 



0.3985 • 



0, 

(fc-87T) + 

l + r?(15/c) 2 ' 



k = 1,..., 24, 1001, 1002,... , 
25 < k < 1000. 



In the second case, of noise variance r\ = 4.5 x 10 5 which led us to the 



choice of (3 = irq' 



-1/6 



13; setting ko 



0.5070 



0, 

(fc-67r) + 
1 + r]{lZkf 



6ir and iVo = 1000 we have 
k = 1,..., 19, 1001, 1002,.. 
20 < k < 1000. 



(Note that in calculating the constants we made use of the exact normaliza- 
tion factor Ca- For our values of rj and (5 the value iVo = 1000 is not large 
enough to make the approximate value given in (|5.4cp useful.) 

Note that even with a large amount of white noise and of smooth signal, 
the location of the jump discontinuity is still clear. When considering jumps 
"corrupted" by low frequency data, we avoid low frequency signals by not 
using low frequency data. This helps keep the smooth signal from corrupting 
our results. On the other hand, because the jump discontinuity has most of 
its energy at low frequencies as well, our technique will increase the noise's 
effect. Comparing Figures [4.21 and T6. 11 we find that the latter is not as clean 
as the former in the sub-figure where the strength of the noise is the same. 
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Signal plus noise, i\ = 0.000020 



Concentration Factor, r\ = 0.000020 





Signal plus noise, n. = 0.000045 



Concentration Factor, n = 0.000045 




0.5 


-0.5 





Figure 6.1: The output for various values of rj when the input consists 
of a piecewise smooth function and noise (of the specified power spectral 
density) . 
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